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(57) ABSTRACT 

An MPEG2 moving picture and encoding/decoding system 
to provide digital copy protection of digital moving picture 
data. The MPEG2 moving picture encoder discrete cosine 
transforms a video input signal and uses a digital watermark 
inserter to embed digital watermark information on a fre- 
quency domain of the discrete cosine transformed video 
input signal. The MPEG2 moving picture decoder receives 
the encoded video output signal from the MPEG2 moving 
picture encoder and removes the embedded visual water- 
mark information to locally decode the encoded video 
signal. s 

18 Claims, 8 Drawing Sheets 
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MPEG2 MOVING PICTURE 
ENCODING/DECODING SYSTEM 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention can be used for a Moving Picture 
Experts Group (MPEG) moving picture compression/ 
decompression application of motion prediction/ 
compensation based on a discrete cosine transform and 
minimizes degradation of image quality. 

This invention relates to a digital copy protection appli- 
cation of moving picture data which is seldom removed 
intentionally or unintentionally by a user except an author, 
and more particularly, relates to an MPEG2 moving picture 
encoder/decoder. 

2. Description of the Related Art 

The MPEG2 standard is a compression/decompression 
standard for video applications, and exploits temporal 
redundancy for motion compensated interpolated and pre- 
dicted encoding. That is, the assumption is made that 
"locally" the current picture can be modeled as a translation 
of the picture at a previous and/or future time. "Locally" 
means that the amplitude and direction of the displacement 
are not the same everywhere in the picture. 

The MPEG2 standard specifies predicted and interpolated 
interframe encoding and spatial domain intraframe encod- 
ing. It has block based motion compensation for the reduc- 
tion of temporal redundancy, and a block based Discrete 
Cosine Transform based on compression for the reduction of 
spatial redundancy. The information relative to motion is 
based on a 16x16 array of pixels and is transmitted with the 
spatial information. Motion information is compressed with 
variable length codes, such as Huffman codes. 

Recently, audio/video information expressed as digital 
information is becoming more widely used and a method 
utilizing digital products also has been increasing accord- 
ingly as digjtalization of the A/V application and popularity 
of the Internet have been increasing rapidly. 

Specifically anybody who is able to use a PC can copy/ 
edit digital products easily and accordingly a social issue of 
illegal copying has been raised, A watermark technique has 
become prominent as a solution to prevent this problem. 

There are two exemplary methods for providing copy 
protection of digital A/V data to prevent illegal copying. The 
first method is encryption, i.e., a copy protection method by 
scrambling the digital information. The second method is a 
digital watermark method with the purpose of preventing the 
illegal use of digital information. 

The first method is a technique for prevention of illegal 
copying of digital A/V data, by providing descramble infor- 
mation and password information capable of accessing and 
running the A/V product only in the case that the A/V 
product is bought legally. 

The second method is a technique which utilizes self- 
restraint by a user to not produce an illegal copy of the A/V 
product by embedding ID information or a logo in a state of 
noise into A/V contents data of the A/V product for the 
purpose of forbidding the illegal or commercial use of 
digital information. The watermark technique is used on the 
original image and is invisible to a person who would copy 
it, but the author can prove that the copied image is his by 
virtue of an arbitrary reverse processing. 

For example, in a case where a counterfeiter forges money 
using a color copier, a vignette on the original bill turns clear 
by copying the bill, and consequently, it makes it virtually 
impossible to copy a bank note. This is called a visible 
watermark. 
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Also, in the case where a spy writes a message onto paper 
with salt water, other people think this is ordinary paper, but 
this paper is a medium having important information for the 
spy. The spy can see the message anytime he wants to see by 
s heating the paper. In this case, we call it an invisible 
watermark. 

At present, the watermark technique is used for digital 
still images or audio, i.e., putting the message distinguish- 
able from the original image into the image. Therefore, in 

10 case that an author's own image circulates illegally, the 
image can be proved to be that of author by performing an 
arbitrary reverse processing. 

Thus, techniques for preventing the illegal copying of 
digital product are increasingly being studied these days. 

15 FIGS. 1 and 2 illustrate a conventional MPEG2 moving 
picture encoder and decoder respectively. FIG. 3 illustrates 
a structure of a video picture used in the MPEG2 moving 
picture encoder/decoder and, FIG. 4 illustrates three types of 
pictures and their relationship under the MPEG2 standard. 

20 We will explain the conventional MPEG2 moving picture 
encoder and decoder by referring to these figures. 

MPEG encoding is a hybrid type lossy coding technique 
wherein the redundancy information which the image sig- 
nals have in the spatial domain and the temporal domain are 
removed and the data are compressed (refer to FIG. 3). At 
this time, the compression technique of spatial domain is 
called intra-coding and the image data used in intra-coding 
are called intra-picrure (in short, I picture). The compression 

3Q technique of temporal domain is called inter-coding and in 
this case, the image data are classified by two according to 
two prediction methods. The first one is a predicted picture 
(P picture) wherein prediction error rate of a forward direc- 
tion is encoded, and the second one is an interpolated picture 

35 or bi-directional picture (B picture) wherein a prediction 
error rate of the bi-directional direction is encoded. 

In other words, the I picture is encoded independently of 
other near pictures (in this instance, the picture is a frame 
signal or a field signal). In the P picture, the difference 

4Q signals of predicted/interpolated movement are encoded 
only after considering the correlation of the movement of the 
previous I picture or P picture. In the B picture, the differ- 
ence signals of predicted/interpolated movement are coded 
only after considering the correlation of the movement of the 

45 previous I or P picture and the next I or P picture. 

Among the three modes, that is, the forward direction 
mode, backward direction mode, and forward and backward 
direction mode, the mode having the smallest value of 
prediction error rate is selected in the prediction/ 

50 interpolation method of the B picture. 

The picture structure of the MPEG recommendation 
(called a main profile, main level; MP@ML) is I, B, B, P, B, 
B, P . . . pictures and needs a frame memory 110 which can 
store at least three pictures (the cycle of a picture). 

55 A field/frame adaptive coding method is possible in an 
MPEG2 encoding method so as to increase coding effi- 
ciency. The unit of the picture can be defined as a field or 
frame according to the purpose of the encoding. A frame/ 
field memory 112 stores the field data or frame data to be 

60 coded. 

A subtracter 134 receives the field data or frame data from 
the frame/field memory 112 and interpolated predicted 
motion data from an adaptive estimator 130, to perform a 
subtraction of local decoded I or P pictures, wherein the 
65 motion prediction is interpolated to encode the prediction 
error rate of the P and B pictures, and the pictures which are 
now input. A Discrete Cosine Transformn (DCT) 114 per- 
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forms an orthogonal transform which transforms image The discrete cosine transform is also Localized. That is, an 

signals from the subtractor 134 spatially structured into encoding process illustrates samples on an 8x8 spatial 

image signals of the frequency domain. A quantizer 116 window which is sufficient to compute 64 transform coef- 

approximates signals to a typical value to map the DCT- ficients or sub-bands. 

transformed image signals to a code book which is defined 5 Another advantage of the discrete cosine transform is that 

in a variable length coder (VLC). Data loss occurs in the fast encoding and decoding algorithms are available, 

quantizer 116. Additionally, the sub-band decomposition of the discrete 

A dequantizer 122 performs an inverse process of the cosine transform is sufficiently well behaved to allow effec- 

quantizer 116 for encoding the prediction error rate of P and tive use of psychovisual criteria. 

B pictures. An inverse DCT (IDCT) 124 performs an inverse 10 After the discrete cosine transform, many of the higher 

process of the DCT 114 for encoding the prediction error frequency coefficients are zero. These coefficients are orga- 

rate of the P and B pictures. A subtractor 126 performs a n ized into a zigzag, as illustrated in FIG. 5, and converted 

subtraction operation on the output from the IDCT 124 and into run-amplitude (run-level) pairs. Each pair indicates the 

the interpolated predicted output from the adaptive estimator number of zero coefficients. This is coded in a variable 

130. A frame memory 128 stores local decoding images 15 length code. 

output from the subtractor 126 according to the dequantizer Discrete cosine transform encoding is carried out in the 

122 and the IDCT 124. mrec stages as nitrated in FIG. 5. The first stage is the 

A motion estimator 132 encodes the prediction error rate computation of the discrete cosine transform coefficients, 

of the P and B pictures output from the frame/field memory The second stage is the quantization of the coefficients. The 

112 and the adaptive estimator 130 is a motion compensator 20 third stage is the conversion of the quantized transformation 

which interpolates predicted motion, providing its output to coefficients into run- amplitude pairs after reorganization of 

the subtractors 126 and 134. the data into a zigzag scanning order. 

An activity calculator 118 reflects the characteristics of Quantization can be viewed as a shift to the right by 

the complexity of the input images to the quantizer 116 and several bits. Quantization enables a very high degree of 

a rate controller 120 sets up the quantizer 116 so that an compression, and a high output bit rate, and retains high 

overflow/underflow of an output buffer 138 does not happen. picture quality. Quantization can be adaptive with an I 

A VLC & MUX (variable length coder and multiplexer) 136 picture having fine quantization to avoid "blockiness" in the 

entropy encodes and multiplexes the signals output from the reconstructed image. This is important because I pictures 

rate controller 120, the quantizer 116 and the motion esti- ^ Q contain energy at all frequencies. By way of contrast, P and 

mator 130. The output buffer 138 provides a buffer for the B pictures contain predominately high frequency energy and 

MPEG coded bit stream output from the VLC & MUX 136. can be coded at a coarser quantization. 

FIG. 2 shows the conventional MPEG2 moving picture One challenge facing decoder designers is the accommo- 

decoder. A buffer 150 stores the coded bit stream. A VLD dation of a single decoder system to a variety of display 

(variable length decoder) & DEMUX 152 performs an 35 output formats, while complying fully with luminance/ 

inverse process of the VLC & MUX 136 (of FIG. 1) to chrominance relationships and the MPEG2 standard. The 

decode the MPEG coded bit stream. A dequantizer 154 displayed output of the decoder chip must conform to 

dequantizes the coded MPEG coded bit stream output from Consultative Committee International Radio (CCIR) recom- 

the VLD & DEMUX 152, and an IDCT 156 performs an mendation 601. This specifies the number of luminance and 

inverse process of DCT of the output of the dequantizer 154. 40 chrominance pixels in a single active line, and also how the 

Adder 160 adds the output of the IDCT 156 with an output chrominance pixels are subsamplcd relative to the lumi- 

of a multiplexer (MUX) 170. A previous picture store 162 is nance signals. 

a memory for motion compensation of the P or B picture The format defined as 4:2:2 is supported in most cases in 

output from the adder 160. A future picture store 164 is a industry. This defines 720 active luminance signals, and 360 

memory for motion compensation of the P picture output 45 color differentiated signals, where each line of luminance 

from the adder 160. An adder 166 performs an addition of signals has a corresponding line of chrominance signals, 

the outputs of the previous picture store 162 and the future CCIR recommendation 656 goes on to define the number of 

picture store 164 when the motion prediction of the B picture active lines for National Television System Committee 

is bi-directional. A l A multiplier 168 multiplies the interpo- (NTSC) and Phase Alternation by Line (PAL) environments 

lation of average values when the motion prediction of the 50 as 480 and .576, respectively. The contents as noted above 

B picture is bi-directional, and the MUX 170 multiplexes the are disclosed in U.S. Pat. No. 5,668,599. 

outputs of the previous picture store 162, the Vi multiplier The MPEG2 moving picture encoder 100 performs an 

168, the future picture storer and a "0" bit. encoding method by utilizing the cooperation of an intrac- 

One picture can be divided into uniformly sized regular oding method on the spatial domain and an interceding 

square areas and each area is transformed. Therefore, the 5s method on the temporal domain. The MPEG2 moving 

image is divided into image ingredients of different frequen- picture encoder 100 performs the intracoding method on the 

cies from an average value (DC value) to an image ingre- spatial domain by compressing the original image into a 

dient value of an extremely high frequency. This division variable length coding of a Huffman code through the DCT 

process is called an orthogonal transformation and the 114 and the quantizer 116 and transmits the variable length 

orthogonal transformation is a discrete cosine transform $0 code. 

(DCT). The MPEG2 moving picture encoder 100 performs the 
Orthogonal transformations, because they have a fre- interceding method on the temporal domain by decompress- 
quency domain interpretation, are filter bank oriented. This ing the I picture compressed on the spatial domain through 
means that the purpose of the DCT is to reduce the corre- the dequantizer 122 and the Inverse Discrete Cosine Trans- 
lation of the image information. Since each DCT- 65 form (IDCT) 124, and predicts by comparing the corn- 
transformed coefficient indicates individual frequency pressed I picture with the image being input at present 
information, the correlation of adjacent coefficients is rare. through the frame memory 128 and the adaptation estimator 
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130, and then encodes a difference signal with the original 
signal by compensating motion, i.e., spatial-shifting the 
image being input at present as much as the predicted 
motion. 

In the case that a method predicting motion is forward 
prediction, we call it the P picture and in case that a method 
predicting motion contains all of forward and backward 
predictions, we call it the B picture. Accordingly, motion 
prediction and compensation of P and B images are affected 
by the picture accuracy coded as the I picture. So, in the 
decoding process decoding the encoded image, first, the I 
picture must be decoded exactly so that the P and B images, 
to which the difference signals are transmitted, can be 
decoded accurately. 

But even through the use of the copy preventing technique 
by encryption and scrambling as noted above, it is possible 
to easily copy data when duplication and key data are 
known. And also the watermark technique for moving 
picture data has some problems which can reduce encoding 
efficiency by embedding ID information and a logo in the 
form of noise. 

The picture structure of an MPEG2 moving picture 
encoding method, as illustrated in FIG. 4, includes an 
intraframe (I picture) reducing spatial redundancy informa- 
tion of image information, a predicted frame (P picture) 
reducing interrelation between frames through forward 
prediction, and an interpolated frame (B picture) reducing 
between frames through bi-direction prediction. 

Therefore, in the decoding of the image signal, only in the 
case where the decoded previous I picture exists, can the P 
picture be decoded perfectly through motion compensation, 
and only in the case where the decoded I and P pictures are 
used in B picture prediction in the encoding process, can the 
B picture be decoded through motion decoding. 

Up to now, digital watermark information discrete-cosine- 
transformed in the form of noise is embedded into an 
original image and an I picture codes this digital watermark 
information. 

And the case of predicting motion of the P and B pictures 
is performed according to encoding locally the I picture. 
Consequently there is a problem of an error while estimating 
motion of the P and B pictures by the mixed watermark 
information. 

Because the watermark technique for still images, which 
has started to be studied recently as noted above, includes 
watermark data on the spatial domain, the watermark tech- 
nique is not suitable for an MPEG encoding method com- 
pressing data by removing redundancy information in accor- 
dance with using interrelation of data on the spatial domain 
and the temporal domain. 

That is, in case the image quality of the image that 
contains the watermark information deteriorates conspicu- 
ously in comparison with the image quality where the 
watermark information is not contained, the meaning can be 
lost because the image can deteriorate even though the 
original object contains watermark information. 

Thus, the image containing the watermark information 
has to appear very similar to the image which does not 
contain the watermark information. 

SUMMARY OF THE INVENTION 

The present invention is devised to solve the above-noted 
problems and can be used by MPEG moving picture 
compression/decompression applications of motion 
prediction/compensation based on the discrete cosine trans- 
form. 



.0,962 Bl 

6 

Accordingly, it is a first object of the invention to provide 
a digital copy protection apparatus of moving picture data 
that makes it difficult to get rid of watermark information by 
a user except an author, in accordance with minimizing 
5 degradation of pixels. 

A second object of the present invention provides an 
MPEG2 moving picture encoder and a third object of the 
present invention provides an MPEG2 moving picture 
decoder. 

10 Also, a fourth object provides an MPEG2 moving picture 
encoding/decoding system with the encoder and the decoder. 

Additional objects and advantages of the invention will be 
set forth in part in the description which follows and, in part, 
will be obvious from the description, or may be learned by 
5 practice of the invention. 

According to a first aspect of the present invention to 
achieve the second object, an MPEG2 moving picture 
encoder includes a frame memory, a frame/field memory, an 
activity calculator, a rate controller, a Discrete Cosine Trans- 

2Q form (DCT) unit, a quantizer, a dequantizer, an Inverse 
Discrete Cosine Transform (IDCT) unit, an adaptation 
predictor, a motion predictor, a variable length Coding & 
Multiplexer VLC & MUX and a buffer, and further includes 
a digital watermark inserter to generate and discrete-cosine - 

^ transform a digital watermark on a frequency domain and is 
installed between the DCT and the VLC & MUX; and a 
digital watermark remover to remove digital watermark 
information on a spatial domain of the DCT embedded for 
preventing an error while estimating motion on a temporal 

3Q domain for P and B pictures by being installed between the 
dequantizer and the IDCT. 

In a second aspect of the present invention to achieve the 
third object, an MPEG2 moving picture decoder includes a 
first buffer to receive and save an encoding bit stream; a 

35 variable length decoder and demultiplexer (VLD & 
DEMUX) to receive the encoding bit stream from the first 
buffer and to various-length-code, and then output the 
various-length-coded bit stream; a dequantizer to receive 
and dequantize the various-length-coded bit stream output 

40 from the VLD & DEMUX; a digital watermark remover to 
remove the digital watermark which has been embedded, to 
locally decode by reading watermark information and infor- 
mation from the dequantizer; a first inverse-discrete cosine- 
transform IDCT to inverse -discrete-cosine-transform the 

45 signal from the digital watermark remover; a digital water- 
mark inserter to again embed the digital watermark removed 
by the digital watermark remover for performing local 
decoding, for the purpose of the decoding output; a second 
IDCT to inverse-discrete-cosine-transform the information 

50 from the digital watermark inserter; a second buffer, when 
the video signal decoded from the second IDCT and the 
motion compensation data are added and then the picture in 
which the digital watermark is embedded is replayed, saving 
temporarily and outputting it; a multiplexer (MUX); a 

55 previous picture store block in which the first IDCT output 
and the MUX output are added and saved temporarily; and 
a future picture store block in which the first IDCT output 
and the MUX output are added and saved temporarily, to 
transmit the saved value into the previous picture store 

6Q block. 

It is preferable that the MUX receives the signal from the 
previous picture storing block, and receives the signal from 
the future picture storing block, and receives the signal 0, 
and receives the signal which is generated after the signals 
65 from the two blocks are added and multiplied (treated). 

And according to a third aspect of the present invention to 
achieve the fourth object, in an MPEG2 moving picture 
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encoding/decoding system, includes an MPEG2 moving activity calculator 218, rate controller 220, dequantizer 222, 

picture encoder, to output an encoded bit stream after IDCT 224, adder 226, frame memory 228, adaptation esti- 

inputting and encoding a video input signal, the MPEG mator 230, motion estimator 232, VLC & MUX 236 and 

moving picture encoder including copy protection means buffer 238 operate in the same fashion as the frame memory 

using a watermark for MPEG2 moving picture data; and an 5 110, frame/field memory 112, DCT 114, quantizer 116, 

MPEG2 moving picture decoder, to decode the encoded bit activity calculator 118, rate controller 120, dequantizer 122, 

stream from the MPEG2 moving picture encoder to output IDCT 124, adder 126, frame memory 128, adaptation esti- 

a decoded video signal, the decoder including means for mator 130, motion estimator 132, VLC & MUX 136 and 

replaying perfectly the image into which the watermark is buffer 138, respectively, shown in FIG. 1 and previously 

embedded. 10 described. 

The digital watermark inserter 240 makes digital water- 

BRIEF DESCRIPTION OF THE DRAWINGS mar fc information not removable by a user except an author 

These and other objects and advantages of the invention and * embedded on a frequency domain 8x8 discrete- 

will become apparent and more readily appreciated from the cosine-transform of the encoded video signal, in order to 

following description of the preferred embodiments, taken 15 me ^xton on hardware. That is, the process of the 

in conjunction with the accompanying drawings of which: dl S ltal watermark insertion by the digital watermark inserter 

, , A , - ^ 240 embeds the watermark information on the frequency 

FIG. 1 shows a conventional MPEG2 moving picture A * j v . * j-. j* •* i 

, to r domain, so that a duplicator cannot edit or remove a digital 

encoder product illegally and arbitrarily 

FIG. 2 shows a conventional MPEG2 moving picture 20 ( ju & ^^ ( gs:^^^^^^ m 4^ 

decoder * located : bet\v«^ 

FIG. 3 shows a structure of a video picture used in a 2r4^~d:thT^ariable-lengthxode r & multiplexer (VLC~a nd 

conventional MPEG2 moving picture encoder/decoder. £MU^2^and:k:alsodo^ 

FIG. 4 shows three types of pictures and their relationship aridZthe-quantizer- 216r-It~is-p referable j that-the-d igitaP 

under the MPEG2 standard, i.e., I pictures, P predicted 25 L waterm aririnse^ 

pictures, and B bi-directionally predicted pictures. DCT2r4^d2the''q uantizer'216~fbr vis ualeffect. 

FIG. 5 shows a sequence wherein discrete cosine trans- Because basically the MPEG2 standard embodies a fre- 
form coefficients are calculated and mixed and the discrete quency domain processing on the discrete cosine transform, 
cosine transform coefficients are quantized in a zigzag ^ the digital watermark inserter 240 of FIG. 6 discrete-cosine- 
manner, transforms the digital watermark information, and then 
FIG. 6 shows a block diagram of an MPEG2 moving embeds the digital watermark information. The watermark 
picture encoder according to an embodiment of the present information is processed and embedded by in the digital 
invention. watermark inserter 240 and then is added to an original 
FIG. 7 shows a block diagram of an MPEG2 moving 35 P^" In P articular ' thc di S ital watermark inserter 240 
picture decoder according to the embodiment of the present mdudes a ^tennaA pattern generator 284 to -generate 
invention digital watermark information (pattern), and a DCT 282 to 
~ , . , , „ ^. „ . discrete-cosine-transform the digital watermark informa- 
FIG 8 shows a b ock diagram of a Discrete Cosine (ioQ ^ digital watermark inserter 240 further includes an 
Transform unit digital watermark inserter and a quantizer adder 280 wh i c h adds the discrete-cosine-transformed digi- 
shown in FIG. 6. 40 (al watermark information from the DCT 282 to the output 

of the DCT unit 214. The added result from the added 280 
is input to the quantizer 216. 
Thus, the watermark information embedded on the fre- 

While the invention is susceptible to various modifica- 45 quency domain is quantized in the quantizer 216 and is 

tions and alternative forms, specific embodiments thereof variable-length-coded in the VLC & MUX 236. This is an I 

have been shown by way of example in the drawings and picture coding process. 

will herein be described in detail. It should be understood, The dequantizer 222 dequantizes the I or P-picture coded 

however, that it is not intended to limit the invention to the data in which the watermark information is embedded and a 

particular forms disclosed, but on the contrary, the intention 5Q digital watermark remover 242 gets rid of the embedded 

is to cover all modifications, equivalents, and alternatives watermark information. An IDCT unit 224 reverse-discrete - 

falling within the spirit and scope of the invention as defined cosine -transforms the I or P-picture coded data for estimat- 

by the appended claims. mg correctly the motion information. Therefore, the MPEG2 

FIG. 6 illustrates a block diagram of an MPEG2 moving moving picture encoder 200 prevents an error of a temporal 

picture encoder 200 according to an embodiment of the 55 domain coding by the watermark information. The MPEG2 

present invention and FIG. 7 illustrates a block diagram of moving picture encoder 200 compensates for the error by 

an MPEG2 moving picture decoder 245 according to the estimating an image motion that is being input at present 

embodiment of the present invention from the I or P picture restored like this, and then codes a 

In FIG. 6, the MPEG2 moving picture encoder includes a difference signal 

frame memory 210, a frame/field memory 212, a subtractor 60 In this instance, the watermark information is embedded 

234, a DCT unit 214, a digital watermark inserter 240, a on the spatial domain in the back of the DCT 2 14. The digital 

quantizer 216, an activity calculator 218, a rate controller watermark inserter 240 embeds the digital watermark infor- 

220, a dequantizer 222, a digital watermark remover 242, an mation only on jhe spjjial_domain_of„me_disCTete_cosine 

IDCT 224, an adder 226, a frame memory 228, an adaptive trajreforr^(o^he^ „J^7 

estimator 230, a motion estimator 232, a VLC & MUX 236, 65 /^e^^td~waterm^ remover 242 removes the_digital 

and a buffer 238. The frame memory 210, frame/field wateWarlfin^iroat^^ 

memory 212, subtractor 234, DCT 214, quantizer 216, cosine transform which was embedded for preventing "the 
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error during the motion estimation on the temporal domain 
for P and B pictures by using the embedded digital water- 
mark information. 

FIG. 7 illustrates the MPEG2 moving picture decoder 245 
to correctly decode an MPEG2 video stream including the 
digital watermark information embedded as in the MPEG2 
moving picture encoder 200 shown in FIG. 6. 

The MPEG2 moving picture encoder includes a first 
buffer 250, a VLD & DEMUX 252, a dequantizer 254, a 
digital watermark remover 270, a first DCT 256, an adder 
260, a previous picture store block 262, future picture store 
block 264, an adder 266, a multiplier 268, a digital order 
mark inserter 272, second IDCT 274, a second buffer 258, 
and an adder 276. The buffer 250, VLD & DEMUX 252, 
dequantizer 254, first IDCT 256, second buffer 258, adder 
260, previous picture store block 262, future picture store 
block 264, adder 266, Vi multiplier 268, operate in the same 
function as the first buffer 150, VLD & DEMUX 152, 
dequantizer 154, IDCT 156, adder 160, previous picture 
store block 162, future picture store block 164, adder 166, 
and Vi adder 168, respectively, shown in FIG. 2 and 
described above. The digital watermark remover 270 
removes the watermark information embedded on the spatial 
domain of the discrete cosine transform while restoring 
motion of the P and B pictures. 

The MPEG2 moving picture decoder 245 performs opera- 
tions in the reverse order of the MPEG2 moving picture 
encoder 200. 

Accordingly in the MPEG2 moving picture decoder 245, 
the watermark information embedded in the MPEG2 mov- 
ing picture encoder 200 has to be transmitted. 

In the case that an encoded MPEG video stream is 
transmitted through a storage medium such as a disk, it is 
possible to perfectly restore motion, referring to it while 
decoding by embedding the watermark on a lead-in domain 
which the user cannot access directly. 

The digital watermark apparatus according to the present 
invention for preventing the illegal copying of MPEG2 
moving picture data makes it possible to prevent degradation 
of the image quality and efficiency reduction of encoding by 
the embedded digital watermark information by decreasing 
the error while estimating motion of the P and B pictures by 
using the embedded digital watermark information. 

In case of decoding locally for compensating motion, 
once the embedded watermark information is removed while 
encoding the I or P picture, and the embedded watermark 
information is decoded locally, then the embedded water- 
mark information is used as data for motion compensation 
while decoding the P and B pictures. 

And in case of decoding for the decoding output, the 
MPEG2 moving picture decoder 221 again embeds the 
watermark information that had been removed once for 
decoding locally in the image signals, and reverse-discrete- 
cosine-transforms the image signals to which the watermark 
information is embedded, and then adds motion compensa- 
tion data thereto. 

Conclusively, the image in which the watermark infor- 
mation is embedded is replayed perfectly. Further, there is an 
effect of decreasing degradation of the image quality to a 
maximum extent by restraining an increase of encoding 
information according to the organization of the present 
invention as noted above, and that the watermark informa- 
tion is not removed easily by a user, except an author. 

What is claimed: 

1. An MPEG2 moving picture encoder to encode a video 
signal with digital watermark information and including a 
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frame memory, a frame/field memory, an activity calculator, 
a rate controller, a Discrete Cosine Transform (DCT) unit, a 
quantizer, a dequantizer, an Inverse Discrete Cosine Trans- 
form (IDCT) unit, an adaptive estimator, a motion estimator, 
a variable length coder and multiplexer (VLC & a MUX) 
and a buffer, the MPEG2 moving picture encoder compris- 
ing: 

a digital watermark inserter installed between said DCT 
and said VLC & MUX, to generate and discrete-cosine- 
transform the digital watermark information, and then 
embed the digital watermark information on a fre- 
quency domain of the video signal; and 

a digital watermark remover, installed between said 
dequantizer and said IDCT, to remove the digital water- 
mark information on a spatial domain of the video 
signal, so as to prevent an error during estimating 
motion on a temporal domain for P and B pictures of 
the video signal. 

2. The MPEG2 moving picture encoder as set forth in 
claim 1, wherein said digital watermark inserter is located 
between said DCT and said quantizer. 

3. The MPEG2 moving picture encoder as set forth in 
claim 1, wherein said digital watermark inserter is located 
between said quantizer and said VLC & MUX. 

4. The MPEG2 moving picture encoder as set forth in 
claim 2, wherein said digital watermark inserter uses an 8x8 
DCT to embed the watermark information on the frequency 
domain of the video signal. 

5. The MPEG2 moving picture encoder as set forth in 
claim 1, wherein said IDCT prevents an error of a temporal 
domain coding by the digital watermark information. 

6. An MPEG2 moving picture decoder to decode an 
encoding bit stream comprising: 

a first buffer to receive and save the encoding bit stream; 

a variable length decoder and multiplexer (VLD & 
DEMUX) to receive the encoding bit stream from said 
first buffer and to various-length-code the encoding bit 
stream; 

a dequantizer to dequantize the various length coded 
signal from said VLD & DEMUX; 

a digital watermark remover to remove a digital water- 

- mark embedded in the dequantized signal to locally 
decode by reading the digital watermark and informa- 
tion from said dequantizer, to generate a dequantized 
signal without the digital watermark; 

a first Inverse Discrete Transform (IDCT) unit to inverse- 
discrete-cosine-transform the dequantized signal with- 
out the digital watermark from said digital watermark 
remover, to generate a first IDCT signal; 

a digital watermark inserter to embed again the digital 
watermark removed by said digital watermark remover 
in the dequantized signal without the digital watermark 
for performing local decoding; 

a second IDCT unit to inverse-discrete-cosine-transform 
the signal from said digital watermark inserter, to 
generate a second IDCT signal; 

a first adder to add the second IDCT signal from said 
second IDCT unit and motion compensation data, to 
generate a first added signal; 

a second buffer to temporarily save the first added signal 
and output the first added signal so that the first added 
signal is replayed; 

a multiplexer (MUX) to multiplex a first saved signal, a 
second saved signal, a third signal having a predeter- 
mined value and a fourth signal to output a multiplexed 
signal; 
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a second adder to add the first IDCT signal and the 
multiplexed signal, to generate a second added signal, 
the second added signal being the motion compensa- 
tion data; 

a previous picture store block to temporarily save the 

second added signal and the second saved signal to 

generate the first saved signal; 
a future picture store block to temporarily save the second 

added signal and to transmit the saved second added 

signal to said previous picture store block and said 

multiplexer as the second saved signal; 
a Vfc multiplier to all the first and second saved signals and 

X A multiplying the added first and second saved signals, 

to generate the fourth signal. 

7. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein said digital watermark remover prevents an 
error of temporal domain coding by the digital watermark. 

8. The MPEG2 moving picture decoder as set forth in 
claim 7, wherein the digital watermark is embedded by the 
watermark inserter within I-picture-codes or P-picture-codes 
of the de quantized signal, and said dequantizer dequantizes 
quantized coefficients of the variable length coded signal, 
and then said digital watermark remover removes the digital 
watermark, in order to prevent the error of the temporal 
domain coding. 

9. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein said digital watermark remover correctly 
predicts motion information relating to an image of the 
encoding bit stream. 

10. The MPEG2 moving picture decoder as set forth in 
claim 8, wherein the digital watermark is embedded by the 
watermark inserter within said the I-picture-codes or 
P-picture-codes, and said dequantizer dequantizes the quan- 
tized coefficients, and then said digital watermark remover 
removes the digital watermark, in order to predict correctly 
motion information relating to an image of the encoding bit 
stream. 
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U. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein the MPEG2 moving picture decoder 
receives the watermark from a recording medium. 

12. The MPEG2 moving picture decoder as set forth in 
5 claim 11, wherein the recording medium is a disk. 

13. The MPEG2 moving picture decoder as set forth in 
claim U, wherein the digital watermark is embedded into a 
domain which a user cannot access directly and a correct 
motion restoration is performed by reference to the digital 

10 watermark when embedding and decoding the digital water- 
mark. 

14. The MPEG2 moving picture decoder as set forth in 
claim 13, wherein the domain, which the user can not access 

15 directly, is a lead-in domain. 

15. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein the MPEG2 moving picture decoder has 
the function to decrease encoding efficiency by embedded 
digital watermark information. 

20 16. The MPEG2 moving picture decoder as set forth in 
claim 15, wherein the MPEG2 moving picture decoder for 
carrying out the function decreases an error while predicting 
motion of P and B pictures by embedding the digital 
watermark information. 

25 17. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein the MPEG2 moving picture decoder has a 
function to prevent degradation of image quality by embed- 
ding the digital watermark. 

18. The MPEG2 moving picture decoder as set forth in 

30 claim 17, wherein the MPEG2 moving picture decoder 
carries out the function by decreasing an error while pre- 
dicting motion of P and B pictures by embedding the digital 
watermark information. 

* * * * * 
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